WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 7 
H04N 7/173 



Al 



(11) International Publication Number: WO 00/59228 

(43) International Publication Date: 5 October 2000 (05.10.00) 



(21) International Application Number: PCT/USOO/08412 

(22) International Filing Date: 30 March 2000 (30.03.00) 



(30) Priority Data; 
60/127,121 
09/458,319 



3 1 March 1 999 (3 1 .03.99) US 
10 December 1999 (10.12.99) US 



(71) Applicant: DIVA SYSTEMS CORPORATION [US/US]; 800 

Saginaw Drive, Redwood City, CA 94063 (US). 

(72) Inventors: SMITH, Aidan, James; 147 Kingston Street, San 

Francisco, CA 94110 (US). GOODE, Christopher, W., B.; 
722 Creek Drive, Menlo Park, CA 94025 (US). 

(74) Agents: MOSER, Raymond, R. et al.; Thomason Moser & 
Patterson, LLP, 2-40 Bridge Avenue, P.O. Box 8160, Red 
Bank, NJ 07701 (US). 



(81) Designated States: AE, AL, AM, AT, AU, AZ, BA, BB, BG, 
BR, BY, CA, CH, CN, CR, CU, CZ, DE, DK, DM, EE, 
ES, FI, GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, 
KE, KG, KP, KR, KZ, LC, LK, LR, LS, LT, LU, LV, MA, 
MD, MG, MK, MN, MW, MX, NO, NZ, PL, PT, RO, RU 
SD, SE, SG, SI, SK, SL, TJ, TM, TR, TT, TZ, UA, UG, 
UZ, VN, YU, ZA, ZW, ARIPO patent (GH, GM, KE, LS, 
MW, SD, SL, SZ, TZ, UG, ZW), Eurasian patent (AM, AZ, 
BY, KG, KZ, MD, RU, TJ, TM), European patent (AT, BE, 
CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, IT. LU, MC, 
NL, PT, SE), OAPI patent (BF, BJ, CF, CG, CI, CM, GA, 
GN, GW, ML, MR, NE, SN, TD, TG). 



Published 

With international search report. 
Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



(54) Title: VIDEO SERVER WITH PLAYLIST MODIFIABLE BY SUBSCRIBER 
(57) Abstract 



A method and apparatus for reducing latency 
caused by information server (125) processing of 
subscriber request wherein a plurality of content 
streams defined by a playlist (111) are sequentially 
provided to a subscriber (106) in a substantially 
seamless manner and wherein the playlist (1 1 1) is 
updated and otherwise maintained in response to 
subscriber commands and requests. 



1252 



125i 



SERVER n 



SERVER 
CONTROLLER 



PLAYLIST 
111 



I 

108 



SCI 



• • • 


SERVER 2 




SERVERt 



sc 



145- 



TRANSPORT 
PROCESSOR 



PLAYLIST 
111-SC 



SESSION CONTROLLER 



TPC 



-150 



FATC 



SUBSCRIBER 
EQUPIMENT 



106 n 




SUBSCRIBER 
EQUPIMENT 



"1 
1062 



106,- 



SUBSCRIBER 
TERMINAL 136 



INPUT 


DISPLAY 


DEVICE 


DEVICE 


138 


140 



SUBSCRIBER 
EQUIPMENT 



FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL Albania 

AM Armenia 

AT Austria 

AU Australia 

AZ Azerbaijan 

BA Bosnia and Herzegovina 

BB Barbados 

BE Belgium 

BF Burkina Faso 

BG Bulgaria 

BJ Benin 

BR Brazil 

BY Belarus 

CA Canada 

CF Central African Republic 

CG Congo 

CH Switzerland 

CI C6te d'lvoire 

CM Cameroon 

CN China 

CU Cuba 

CZ Czech Republic 

DE Germany 

DK Denmark 

EE Estonia 



ES 


Spain 


LS 


Lesotho 


sr 


FI 


Finland 


LT 


Lithuania 


SK 


FR 


France 


LU 


Luxembourg 


SN 


GA 


Gabon 


LV 


Latvia 


SZ 


GB 


United Kingdom 


MC 


Monaco 


TD 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


GH 


Ghana 


MG 


Madagascar 


TJ 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


GR 


Greece 




Republic of Macedonia 


TR 


HU 


Hungary 


ML 


Mali 


TT 


IE 


Ireland 


MN 


Mongolia 


UA 


IL 


Israel 


MR 


Mauritania 


UG 


IS 


Iceland 


MW 


Malawi 


US 


IT 


Italy 


MX 


Mexico 


uz 


JP 


Japan 


NE 


Niger 


VN 


KE 


Kenya 


NL 


Netherlands 


YU 


KG 


Kyrgyzstan 


NO 


Norway 


ZW 


KP 


Democratic People's 


NZ 


New Zealand 






Republic of Korea 


PL 


Poland 




KR 


Republic of Korea 


PT 


Portugal 




KZ 


Kazakstan 


RO 


Romania 




LC 


Saint Lucia 


RU 


Russian Federation 




LI 


Liechtenstein 


SD 


Sudan 




LK 


Sri Lanka 


SE 


Sweden 




LR 


Liberia 


SG 


Singapore 





Slovenia 

Slovakia 

Senegal 

Swaziland 

Chad 

Togo 

Tajikistan 

Turkmenistan 

Turkey 

Trinidad and Tobago 

Ukraine 

Uganda 

United States of America 

Uzbekistan 

Viet Nam 

Yugoslavia 

Zimbabwe 



WO 00/59228 



PCT/US00/08412 



METHOD FOR REDUCING LATENCY IN AN INTERACTIVE 
INFORMATION DISTRIBUTION SYSTEM 

CROSS R EFERENCE T O RELATED APPLICATIONS 
5 This application claims benefit of U.S. Provisional Patent Application 

Serial Number 60/127,121 (attorney docket number 043), which was filed on 
March 31, 1999 and is incorporated herein by reference in its entirety. 

BACKGROUND OF THE INVENTION 

10 

1. Field of the Invention 

The present invention relates to an information distribution system 
such as a video-on-demand (VOD) system providing information services to 
15 a plurality of subscribers. More particularly, the present invention relates 
to a method for reducing the latency experienced by system subscribers 
transitioning between offered information services within such a system 
while maintaining high quality presentation of subscriber requested 
information services. 

2. Description of the Background Art 

In an information distribution system, such as video on demand 
(VOD) system, an information provider (e.g., a head-end in a cable television 
system) must control of the distribution of requested information to ensure 
that requests for information, such as video information, are satisfied in an 
orderly manner. 

Compression and decompression techniques utilized within such 
systems to efficiently store and provide content to system customers (e.g., 
users or subscribers within a VOD system), as well as processing of control 
information provided by such customers requires a substantial amount of 
time. As such, a customer may experiences a significant delay or latency 
between the time a function is selected (via a set top terminal or set top box 
associated with the customer) and the time that the selected function is 
actually implemented upon the screen of their television. Heretofore this 



WO 00/59228 PCT/US00/08412 

2 

latency has merely been an annoyance which, for the most part, has been 
ignored by the interactive information distribution system providers. 

Typically, upon selection of a certain function, such as stop or pause, 
while viewing a particular video stream, the present VOD systems merely 
5 delay the time of implementing that stop or pause function by the amount of 
latency, which can be in excess of five seconds. Furthermore, if a customer 
has a particular video stream being displayed and then selects a second 
video stream for display, present systems, after a slight control signal 
processing delay, switch from one video stream to another video stream 

10 without any attempt to smooth the transition. As such, the video that is 
received and decoded by the user's set top terminal is generally garbled or 
distorted during the transition period. If a customer is rapidly switching 
from video stream to video stream, e.g., channel surfing, the customer will 
view garbled video images for a substantial amount of time between 

15 "channel" changes. Such an extended period of garbled images is 
unacceptable for a commercial system. 

A method and apparatus for masking the effects of latency within an 
interactive information distribution system is described in U.S. Patent No. 
5,781,227, issued July 14, 1998 and assigned to DIVA Systems Corporation 

20 of Redwood City, California. The '227 patent utilizes, inter alia, video and 
audio masking techniques at the set top terminal to mask latency inherent 
in transitioning between information streams. 

Unfortunately, the '227 patent masks latency without addressing 
contributions to system latency caused by information server processing of 

25 subscriber requests. Therefore, there is a need in the art for a method and 
apparatus for avoiding the effects of latency in an interactive information 
distribution system. More specifically, there is a need for a method and 
apparatus for reducing latency caused by information server processing of 
subscriber requests. 



30 



SUMMARY OF THE INVENTION 
The disadvantages heretofore associated with the prior art are 
overcome by the present invention of a method and apparatus for reducing 
latency wherein a plurality of content streams defined by a playlist are 
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sequentially provided to a subscriber in a substantially seamless manner 
and wherein the playlist is updated and otherwise maintained in response 
to subscriber commands and requests. It is also seen to be desirable to 
ensure that a plurality of user requests for content are structured as a 
5 concatenated series of video clips or other content, such that user navigation 
of the concatenated content is enabled. 

The present invention operates to synchronize, to the extent possible, 
the streaming or providing of various content streams to a customer within 
an interactive information distribution system such that transitions 
10 between provided content streams are anticipated and smoothly executed. 

Specifically, in an information distribution system including provider 
equipment and subscriber equipment, the provider equipment 
communicating to the subscriber equipment information streams 
representing content requested by the subscriber equipment, an apparatus 
15 according to the invention comprises: a session manager, for interacting 
with the subscriber equipment and maintaining a playlist, the playlist 
defining at least one content stream to be provided to the subscriber; a 
server, for storing content streams; and a server controller, for retrieving 
from the server content streams defined by the playlist, the content streams 
20 being provided to the subscriber; wherein the session manager modifying 
the playlist in response to playlist modification commands received from the 
subscriber equipment. 

BRIEF DESCRIPTION OF THE DRAWINGS 
25 The teachings of the present invention can be readily understood by 

considering the following detailed description in conjunction with the 
accompanying drawings, in which: 

FIG. 1 depicts a high level block diagram of an interactive 
information distribution system containing the present invention; and 
30 FIG. 2 depicts a flow chart of a method according to the present 

invention; and 

FIG. 3 depicts a flow diagram of a method for updating and utilizing a 
play list to direct the flow of content to a user. 



WO 00/59228 



4 



PCTYUS00/08412 



To facilitate understanding, identical reference numerals have been 
used, where possible, to designate identical elements that are common to 
the figures. 

DETAILED DESCRIPTION 

The present invention will be primarily described within the context 
of a video on demand (VOD) systems providing content encoded according to 
the various Moving Pictures Experts Group (MPEG) standards are known. 
For example, a first standard known as MPEG-1 refers to ISO/IEC 
standards 11172, which is incorporated herein by reference in its entirety. 
A second standard known as MPEG-2 refers to ISO/IEC standards 13818, 
which is incorporated herein by reference in its entirety. Additionally, a 
compressed digital video system is described in the Advanced Television 
Systems Committee (ATSC) digital television standard document A/53, 
incorporated herein by reference. It will be appreciated by those skilled in 
the art that the teachings of the present invention may be advantageously 
applied to other information distribution systems where components or 
functional elements within the system are bandwidth constrained. 

A primary purpose of this invention is to enable information services 
that would be best implemented by sequencing video clips from a file server 
and presenting the sequence of video clips on, e.g., a display device in a 
manner avoiding visible or audible anomalies. 

PIG. 1 depicts a high level block diagram of an interactive 
information distribution system. Specifically, FIG. 1 depicts a high level 
block diagram of an interactive information distribution system 100 
containing the present invention. The system 100 contains service provider 
equipment 102, a communications network 104 and subscriber equipment 
106 n , where n is an integer greater than zero. 

The service provider equipment 102 comprises a server controller 108, 
a plurality of servers 125 r 125 m (collectively servers 125), a session 
controller 145 and a transport processor 150. It should be noted that only 
one server 125 is required to practice the invention. 

The servers 125 are used to store content such as movies, television 
programs and other information offerings of the interactive information 
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distribution system 100 of FIG. 1. Additionally, the servers 125 are used to 
store assets such as bit map imagery, graphic overlay, control scripts and 
the like. The assets may comprise, for example, navigation assets that are 
used by a set top terminal to interactively navigate, and select for viewing, 
5 the offerings or content available from the service provider equipment 102. 
The servers 125, in response to a control SC produced by the session 
controller 145, provide content and/or asset data to the transport processor 
150. 

The server controller 108 interacts with the at least one server 125 
10 (e.g., a disk drive array) that generally stores the subscriber information 
(e.g., video data) that will be recalled and downloaded to the subscriber. 
Optionally, a plurality of servers 125 2 - 125 m , where m is an integer greater 
than zero, may interact with the information server 108. The server 
controller 108 controls the access of information, such as video information, 
15 from the servers 125 and the providing (via the transport processor 15) of 
the accessed information to a set top terminal of a subscriber requesting the 
information. Information requests are handled by the session controller 145 
and communicated to the server controller 108. 

The server controller 108 is coupled to the session controller 145 via 
data path SC. The server controller 108 includes a playlist 110-PL that is 
used to store a list of content requested by each respective subscriber. 
Optionally, the playlist may be stored in the session controller 145 as 
playlist 145-PL. The operation of the playlist will be described in more 
detail below with respect to FIG. 2. 

The server controller 108 is coupled to the session controller via data 
path SC, synchronization clock path 118 and control path 120. The server 
controller 108 provides data streams on data path 116 and a 
synchronization clock on path 118 in response to requests for information 
from the session controller on path 120. The data streams are retrieved 
from the data storage unit 114-1. 

Each of the servers 125 stores a plurality of content streams, such as 
video content streams including associated audio content. It is noted that 
these content streams may include auxiliary program information, such as 
fast forward (FF) and rewind (REW) tracks or streams. A FF track 
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comprises, effectively, a temporally sub-sampled version of a main program 
of the content stream. A REW track comprises, effectively, a reverse- 
ordered and temporally sub-sampled version of the main program of the 
content stream. Such FF and REW tracks are suitable for enabling FF and 
5 REW functionality in the information distribution system 100 of FIG. 1. 
That is, a subscriber may request that a presently presented program be 
"fast forwarded" or "rewound" to some future or previous point in the 
program at a rate of, e.g., 5 to 11 times the normal play rate. The 
appropriate server 125 responsively begins streaming the FF or REW track 
10 to the subscriber in response to the request. 

The session controller 145 (or session controller) provides session 
control of the information flowing to and from the servers 125, and may be 
generally described as a system providing or controlling communications 
between, for example, a cable system head-end and one or more set top 
15 terminals. The session controller 145 produces the storage control signal SC 
for controlling and communicating with the servers 125, and a transport 
processor control signal TPC for controlling and communicating with the 
transport processor 150. In response to a user request for particular 
content, the session controller 145 causes the requested content file and any 
associated assets to be streamed from the appropriate server 125 to the 
transport processor 150. 

The session controller 145 sends data, such as commands, encryption 
keys and the like, to set top terminals via a forward data channel (FDC). 
The session controller 145 receives data, such as information stream 
requests and session initiation data (set top identification, capability and 
the like) via a reverse data channel (RDC). The FDC and RDC are 
supported by the distribution network 104 and comprise relatively low 
bandwidth data channels, such as one-two megabits per second data 
channels utilizing QPSK, QAM, or other modulation techniques. The FDC 
and RDC are also known as "out-of-band" channels, while the relatively high 
bandwidth forward application transport channel (FATC) is also known as 
an "in-band" channel. The session controller 145 contains an interface 
device for sending control information via the forward data channel FDC 
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and receiving control information and request information via the reverse 
data channel RDC using the so-called "out-of-band" carrier frequencies. 

The transport processor 150 accomplishes all of the forward content 
channel transmission interface requirements of the system 100 of FIG. 1. 
5 Specifically, the transport processor 150 is coupled to subscriber equipment 
via the forward applications transport channel (FATC). That is, the 
transport processor 150 is capable of providing a plurality of scrambled or 
unscrambled content and/or asset streams modulated onto various carrier 
frequencies suitable for use in the distribution network 104. The FATC is 
10 supported by the distribution network 104 and comprises a relatively high 
bandwidth communications channel well suited to carrying video, audio and 
data such as, for example, multiplexed MPEG-2 transport packets. It 
should be noted that data normally conveyed to a set top terminal via the 
FDC may be included in the FATC data stream. The transport processor 
15 150 also contains a modulator for modulating the combined content and 
asset stream onto one or more carrier frequencies for transmission on the 
FATC, the so-called "in-band" carrier frequencies. 

The distribution network 104 can be any one of a number of 
conventional broadband communications networks that are available such 
20 as a fiber optic network, a telephone network, existing cable television 
network and the like. For example, if the network is a hybrid fiber-coax 
network, the transmission transport technique used in both forward 
channels may be modeled after the Moving Pictures Expert Group (MPEG) 
transport protocol for the transmission of video data streams. In general, 
25 the transport mechanism for both of the forward channels that transport 
information to the set top terminal must be able to carry unidirectional, 
asynchronous packetized data such as that defined in the MPEG video and 
audio signal transmission protocol, and the like. There are a number of 
such transport protocols available. 
30 The subscriber equipment 106 comprises a set top terminal or a set 

top box 136, a display device 140 (e.g. a conventional television) and a user 
input device 138 (e.g. a remote control device). Each set top terminal 136 
receives the data streams from the FATC, demodulates the received data 
streams and, in the case of video streams, processes the demodulated video 
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streams for subsequent display on the display device 140. In the case of 
receiving scrambled data streams, the STT descrambles the received data 
streams using the descrambling messages DM provided to the STT via the 
FATC or the FDC. The STT uses the authorization messages AM provided 
5 via the FATC or FDC to determine if a descrambling of the received 
scrambled stream is authorized. In addition, the set top terminal 136 
accepts commands from the remote control input device 138 or other input 
device. These commands are formatted, modulated, and transmitted 
through the distribution netwprk 104 to the session controller 145. 
10 Typically, this transmission is accomplished through the reverse data 
channel RDC. These commands are preferably transmitted through the 
same network used to transmit information to the set top terminal. 
However, the RDC coupling the set top terminal to the provider equipment 
102 may be a separate network, e.g. a FATC through a television cable 

15 network and an RDC through a telephone network. The telephone network 
could also support the FDC. 

The inventors have determined that latency minimization is most 
readily achieved where the hardware or software module controlling the 
providing or streaming of video and other content to subscribers has 

20 knowledge about what content to stream out once the currently streamed 
content terminates. That is, where the controlling hardware or software 
module does not need to communicate with another hardware or software 
module to determine what to play next. Thus, the present invention utilizes 
a "playlist" comprising a list of content streams that may be concatenated in 

25 a substantially seamless (i.e., low- or no-latency) manner to provide an 
enjoyable presentation experience to a subscriber. 

In one embodiment of the invention, the session controller 145 
includes a playlist 111-SC that stores a list of content streams for each 
subscriber scheduled to receive a content stream. For example, a playlist for 

30 a subscriber may comprise data identifying the title, storage location, and 
presentation time of one or more content streams, such as movies, music 
and the like. 

Each content stream identified in the playlist has associated with it 
at least a storage location parameter indicative of the server 125 including 
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the content stream. Additionally, the playlist may identify auxiliary 
information streams, such as fast forward (FF) and rewind (REW) content 
streams. Upon reaching the end (i.e., terminating) of a presently provided 
content stream (i.e., a stream being coupled to a subscriber via the FATC), 
the server controller 108 immediately accesses (from one of the storage units 
114) the next content stream and begins streaming the accessed content 
stream to the subscriber. 

In the case of the server controller 108 not being able to 
independently access the playlist 111 (e.g., the playlist is located in the 
session controller 145 or other portion of the information distribution 
system 100), the following mechanism is used. Specifically, at a 
predetermined point prior to reaching the end of the presently provided 
content stream, the server controller 108 indicates to the session controller 
145 that the end point is approaching. In response, the session controller 
145 instructs the server controller 108 as to the next content stream to be 
provided to the subscriber. The amount of time required for the server 
controller 108 to transmit the notification to the session controller 145 and 
receive a response from the session controller 145, must be less than the 
remaining streaming time of the presently provided content stream. 

To ensure smooth transitions between content streams, all content 
assets, such as video, audio and other information subject to inclusion in the 
playlist, are constructed in a manner facilitating inter-asset transition (i.e., 
seamless splicing) such that a smooth presentation of the requested assets 
may be made by the set top terminal. 

For example, in the case of a video asset constructed according to the 
various MPEG requirements, the splicing capability included within the 
MPEG standard and/or the SMPTE splicing syntax is utilized to facilitate a 
brief transition between streams at the set top terminal. Specifically, each 
content stream incorporates a plurality of splicing points according to, e.g., 
splicing standards adopted by the Society of Moving Pictures Television 
Engineers (SMPTE). These standards provide for the insertion of splice 
point indicators in, e.g., transport packet headers indicative of whether 
underlying included video elementary streams may be spliced at a 
particular transport packet boundary. Thus, the first transport packet of a 
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stored content stream comprises a splicing entry point (in-point) and the 
last transport packet a splicing exit point (out-point). Such entry and exit 
points are provided throughout the stored content stream such that rapid 
transitioning between streams may be effected, thereby reducing subscriber- 
experienced latency. 

In the interactive information distribution system 100 of FIG. 1, a 
playlist or play queue 111 is depicted as residing within the server 
controller 108. It should be noted that a single playlist or play queue 111 is 
utilized for one subscriber. Thus, the playlist or play queue 111 actually 
comprises a plurality of playlists, where each of the plurality of playlists is 
associated with a respective subscriber or set top terminal. In this manner, 
each of the plurality of set top terminals may benefit from low latency 
transitioning between respective requested content streams. 

A content stream is added to a subscriber's playlist in response to a 
content "add" command and deleted from the subscriber's playlist in 
response to a content "delete" command as in response to a termination of 
availability of the content (e.g., when a "window of availability" of the 
content expires). In this manner, the subscriber defines, in advance, the 
content streams to be provided over a relatively long period of time such 
that each subscriber receives customized programming. Such additions and 
deletions will not add latency if they are made at a time other that the 
above-described the termination notification mechanism. 

The presently provided content stream is terminated and the next 
content stream identified in the playlist 111 is provided in response to a 
"skip forward" command received from the subscriber. Likewise, the 
presently provided content stream is terminated and the previous content 
stream identified in the playlist 111 is provided in response to a "skip 
backward" command received from the subscriber. Such skipping will not 
add latency if the server controller 108 knows precisely which content 
stream is to be accessed. 

The presently provided content stream is terminated and the fast 
forward (FF) or rewind (REW) associated stream is provided in response to 
the "FF" or "REW" command received from the subscriber. Transitioning to 
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the FF or REW track or content stream will not add latency if the server 
controller 108 knows precisely where such streams are located. 

It will be appreciated by those skilled in the art that the playlist or 
play queue 111 may be located in the session manager 122 itself or any 
5 functional element in communication with the session manager 122 such 
that the session manager 122 may update and/or maintain a playlist or play 
queue 111 for some or all of the subscribers within the information 
distribution system 100. 

FIG. 2 depicts a flow diagram of a method suitable for use in the 

10 interactive information distribution system of FIG. 1. Specifically, FIG. 2 
depicts a method 200 suitable for use in the session manager 122 of the 
information distribution system 100 of FIG. 1. When operating according to 
the method 200 of FIG. 2, the session manager 122 maintains a playlist for 
each subscriber within the information distribution system 100. In this 

15 manner, transitions between content streams may be managed in an 

efficient, low latency manner without producing undesirable image or audio 
artifacts upon presentation by the subscriber. 

The method 200 is entered at step 205 when the session manager 122 
establishes a session with a Set Top Terminal (STT) or Set Top Box (STB) 

20 associated with a subscriber. At step 210 a query is made as to whether an 
existing playlist is available. If the query at step 210 is answered 
negatively, then a playlist is created at step 215 and the method 200 
proceeds to step 220. If the query at step 210 is answered affirmatively, then 
the method proceeds directly to 220. 

25 At step 220 the session manager 122 waits for a command from the 

STT or termination notification from the server controller. Upon receiving a 
command from the STT, the method 200 proceeds to step 225. Upon 
receiving a termination notification from the server controller, the method 
200 proceeds to step 275. A termination notification is produced by the 

30 server controller to indicate that a presently streamed, or "active" content 
stream is almost finished streaming. That is, the portion of the active 
content stream not yet provided to the STT is below a temporal or other 
threshold level (i.e., a predefined amount of time or data not yet provided). 
As such, to ensure a smooth transition to the next content stream, the 
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server control must be provided with information identifying the location 
and other parameters associated with the next content stream to be 
provided. 

At step 275, the session manager 122 examines the playlist and 
5 identifies the next content stream to be provided to the STT. At step 280 
the identified next content stream to be provided to the STT is 
communicated to the server controller 108 such that the server controller 
may transition between the present (active) content stream and the next 
content stream. The method 200 then proceeds to step 220, to wait for the 

10 next command or termination notification. 

At step 225 a query is made as to whether the command received 
from the STT is either a "start" or "stop" command. If the query at step 225 
is answered negatively, then the method 200 proceeds to step 235. If the 
query at step 225 is entered affirmatively, then the method 200 proceeds to 

15 step 230, where the providing (i.e., streaming) of the active content stream 
to the STT is, respectively, started or stopped. The method 200 then 
proceeds to step 220, to wait for the next command or termination 
notification. 

At step 235 a query is made as to whether the command received 
from the STT is either an "add" or "delete" command. If the query at step 
235 is answered negatively, then the method 200 proceeds to step 245. If 
the query at step 235 is answered affirmatively, then the method 200 
proceeds to step 240, where the content stream associated with the add or 
delete command is, respectively, added to or deleted from the playlist. The 
method 200 then proceeds to step 220, to wait for the next command or 
termination notification. 

At step 245 a query is made as to whether the command received 
from the STT is either an "skip forward" or "skip backward" command. If 
the query at step 245 is answered negatively, then the method 200 proceeds 
to step 255. If the query at step 245 is answered affirmatively, then the 
method 200 proceeds to step 250, where the presently streamed or "active" 
playlist content is skipped in favor of the next (skipped forward) or previous 
(skipped backwards) content identified within the playlist. That is, the 
content stream presently being provided to the STT is terminated and a new 
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content stream is provided in its place. The new content stream is the 
content stream immediately following (i.e., next) or preceding (i.e., previous) 
the terminated content stream. The method 200 then proceeds to step 220, 
to wait for the next command or termination notification. 

At step 255 a query is made as to whether the received command is a 
fast forward or rewind command. If the query at step 255 is answered 
negatively, then the method 200 proceeds to step 270. If the query at step 
255 is answered affirmatively, then the method 200 proceeds to step 260, 
where a fast forward or rewind stream associated with the active playlist 
content is utilized. Thus, in response to a fast forward or rewind command, 
the content stream presently being provided to the STT is terminated and 
the respective fast forward or rewind stream associated with the terminated 
content stream is provided in its place. The method 200 then proceeds to 
step 220, to wait for the next command or termination notification. 

At step 270, a received command other than the commands discusses 
above with respect to steps 225-260 is processed in the normal manner. 
Such commands may include, for example, billing or status query 
commands, general information requests from the STT, navigation 
commands and the like. The method 200 then proceeds to step 220, to wait 
for the next command or termination notification. 

To facilitate near seamless or seamless transitions between content 
streams (i.e., little or no visual or audible artifacts), the content streams and 
any associated fast forward (FF) and rewind (REW) streams are constructed 
in a manner facilitating such smooth transitions between streams. 
Specifically, as discussed above, such streams are constructed in a manner 
provide SMPTE splice points at the beginning, end and various points 
within the stream. In this manner, transport layer decisions may be made 
to ensure proper splicing. 

It should be noted that some non-zero latency is associated with a 
change in the sequential presentation of playlist defined content streams. 
However, such latency is mitigated by careful construction of content 
streams (e.g., many splice points), by ensuring that the stream controller 
108 has continuous access to the playlist 111 (e.g., locating the playlist 111 
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within the server controller 108) and by utilizing subscriber-side latency 
masking techniques such as those described in U.S. Patent No. 5,781,227. 

FIG. 3 depicts a flow diagram of a method for updating and utilizing a 
play list to direct the flow of content to a user. Specifically, the method 300 
of FIG. 3 depicts set top terminal processes 310, session controller processes 
320, and server controller processes 330. As previously discussed, a play list 
111-SC may be stored within the session controller 145 and used to adapt 
the operation of the server controller 108 in response to requests provided 
by the subscriber equipment 106, illustratively set top terminals or 
subscriber terminals 136 communicating with the session controller 145 via 
the reverse data channel RDC. 

The method 300 of FIG. 3 is initiated at steps 312 and 321, where a 
session is established between a subscriber terminal and the session 
controller. That is, at step 312, a set top terminal 136 operates to establish 
a session with the session controller 145 and submit any new content 
requests. At step 321, the session controller 145 operates to establish a 
session with the set top terminal. The method 300 then proceeds to step 
322, where the session controller 145 accesses the play list associated with 
the set top terminal requesting a session at step 312. The method 300 then 
proceeds to step 323. 

At step 323, the session controller 145 requests the streaming of the 
play track of the first content stream of the requesting set top terminal. 
That is, at step 323 the portion of the play list 111-SC accessed at step 322 
that is associated with the requesting set top terminal is used to define a 
first content stream to be provided to that set top terminal. The request to 
stream the play track of the first content stream is communicated to the 
server controller 108. The method 300 then proceeds to step 331. 

At step 331, the server controller 108 responds to the stream request 
of step 323 by streaming the play track of the first content stream 
associated with the requesting subscriber. The method 300 then proceeds to 
step 332. 

At step 332, a query is made as to whether the stream presently 
being provided to the requesting set top terminal is due to terminate within 
"x" seconds. That is, a determination is made as to whether the stream 
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provided to the set top terminal is scheduled to terminate within a 
predefined time period, illustratively "x" seconds where "x" may be any real 
or integer number. The query at step 332 is repeatedly performed until the 
stream being provided to the set top terminal is within the threshold time 
5 period preceding termination of that stream. Thus, when the stream 

presently being provided to the set top terminal is within the predetermined 
temporal window prior to stream termination, the method 300 proceeds to 
-.step 333. 

At step 333, the server controller 108 sends a stream termination 
10 message to the session controller 145. The stream termination message 
includes information such as the stream presently being provided, the 
subscriber or subscribers presently receiving the stream and other relevant 
information. The method 300 then proceeds to step 324. 

At step 324, the session controller 145 accesses the play list to 
15 determine the next content stream to be provided to the requesting set top 
terminal. The session controller 145 also transmits a request to the server 
controller 108 to begin streaming the determined content stream upon 
termination of the present content stream. The method 300 then proceeds 
to step 334. 

20 At step 334, the server controller 108, in response to the request 

transmitted to the session controller 145 at step 324, transitions the output 
stream provided to the requesting set top terminal from the present content 
stream to the next content stream within the play list. Such transition 
occurs at the termination point of the presently streamed content stream. 
Ideally, such transition occurs in a relatively seamless manner such that no 
undesirable visual or aural artifacts are induced upon the presentation 
devices associated with the requesting set top terminal. As previously 
noted, the interactive information distribution system 100 of FIG. 1 provides 
for "VCR-like" capabilities. The adaptation of the present invention to VCR- 
like commands will now be discussed with respect to FIG. 3. 

At step 314, a set top terminal receiving a content stream submits a 
fast forward or rewind request to the session controller 145. That is, the set 
top terminal requests that the play track of the presently streamed content 
be exited and the associated fast forward track be entered at a point indexed 
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to the present play point. The method 300 then proceeds to step 325. At 
step 325, the session controller 145 receives a fast forward/rewind request 
from a subscriber and passes this request to the server controller 108. The 
method 300 then proceeds to step 335. 
5 At step 335, the server controller 108 transitions the stream provided 

to the user from the play track to the fast forward or rewind track. That is, 
the server controller 108 selects a point within the play track at which the 
play track will be exited. A corresponding entry point into the fast 
forward/rewind track is then selected. Upon reaching the exit point, the 
10 server controller 108 causes the server 125 to transition from the play track 
to the appropriate fast forward/rewind track at the index point. In this 
manner, the requested fast forward/rewind track of the content stream is 
provided to the set top terminal in response to the request at step 314. The 
method 300 then proceeds to step 332, where a determination is repeatedly 
15 made as to whether the presently provided stream is scheduled to terminate 
within a predefined time window. In this case, the presently provided 
stream will be the fast forward or rewind track associated with the content 
being provided to the requesting set top terminal. 

At step 316, a pause or play request from the set top terminal 136 is 
transmitted to the session controller 145. The method 300 then proceeds to 
step 326 where the session controller 145 passes the pause or play request 
to the server controller 108. The method 300 then proceeds to step 336, 
where the server controller 108 causes a "freeze frame" to occur (in response 
to a "pause" command) or causes an entry of the play track associated with 
the requested content at the previous pause point. That is, in response to a 
pause command, the server controller 108 repeatedly streams to the 
subscriber information causing a single frame to be repeatedly presented. 
Alternatively, the session controller 145 may cause circuitry within the set 
top terminal to perform a local "freeze frame." Such circuitry may comprise, 
for example, a frame buffer within the set top terminal responsive to 
commands received from the session controller 145. Such set top terminal 
functionality is known. In the case of a play command, if a stream being 
provided to the set top terminal comprises a paused or "freeze frame" 
stream, a fast forward track or a rewind track, the server controller 108 
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causes the server 125 to begin serving the play track of the requested 
content at the previously selected pause point, or at a transition point at 
which the fast forward track or rewind track is exited. In this manner, a set 
top terminal 136 may terminate a pause, fast forward or rewind 
5 presentation. The method 300 then proceeds to step 332. 

At step 318, a skip forward or back request is transmitted by the set 
top terminal 136 to the session controller 145. Then method 300 then 
proceeds to step 327. At step 327 the session controller responsively 
increments or decrements a play list pointer in response to the skip forward 
10 and skip back command. The method 300 then proceeds to step 328, where 
the session controller 145 sends a request to the server controller 108 
indicating that the next or previous content within the play list associated 
with the requesting set top terminal should be played. The method 300 
then proceeds to step 337. 
15 At step 337, the server controller 108 receives the request to begin 

streaming the next or previous content stream, and responsively acts as the 
play track associated with the next or previous content stream and begins 
providing that stream to the requesting set top terminal. The method 300 
then proceeds to step 332. 

The operation of the method 300 at step 332 is interrupted in the case 
of a fast forward/rewind request (step 314), pause/play request (step 316) or 
skip forward/back request (step 318). That is, the session controller 145 
indicates to the server controller 108 that a set top terminal command has 
been received and must be processed. 

The method 300 of FIG. 3 illustrates several functional aspects of the 
present invention. First, the present invention operates to determine if 
content being streamed will be terminated within a predefined time period. 
Upon determining that streamed content will terminate shortly, the play 
list associated with the set top terminal receiving the content is accessed 
and the next content to be provided to the set top terminal is determined. 
This information is then utilized by the server controller 108 to effect a 
smooth transition between the stream scheduled for termination and the 
next stream to be provided. 
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A second functional aspect of the present invention is the user 
manipulation of content. Specifically, user commands for manipulating 
content (such as fast forward, rewind, play or pause commands) are 
incorporated into the processing of the content by both the session controller 
145 and server controller 108. In this manner, the benefits of utilizing the 
play list according to the invention do not detract from the interactive 
experience provided to the user of the system. 

A third functional aspect of the present invention is the user 
manipulation of the play list. For example, a user may update the play list 
by requesting additional content to be provided. Such updates to the play 
list append content identifiers to the play list associated with the requesting 
user. The content identifiers are subsequently used to retrieve the 
appropriate content upon termination of the content immediately 
proceeding the new content. The user may also provide skip forward and 
skip back requests which cause the, respectively, next or previous content 
within the play list to be provided to the user. In this manner, the user 
maintains control of the content presently being streamed as well as gains 
control of content to be streamed in the future. 

Although various embodiments which incorporate the teachings of the 
present invention have been shown and described in detail herein, those 
skilled in the art can readily devise many other varied embodiments that 
still incorporate these teachings. 
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What is claimed is: 

1. In an information distribution system including provider equipment 
5 (108-150) and subscriber equipment (106), said provider equipment 

communicating to said subscriber equipment information streams including 
content requested by said subscriber equipment, apparatus comprising: 

a session manager (145), for interacting with said subscriber 
equipment and maintaining a playlist (111), said playlist defining at least 
one content stream to be provided to said subscriber; 
a server (125), for storing content streams; and 
a server controller (108), for retrieving from said server content 
streams defined by said playlist, said content streams being sequentially 
provided to said subscriber; 

said session manager modifying said playlist in response to playlist 
modification commands received from said subscriber equipment. 

2. The apparatus of claim 1, wherein: 
said modification commands comprise at least one of an add 

command, a delete command, a skip forward command, a skip backwards 
command, a fast forward command and a rewind command. 

3. The apparatus of claim 2, wherein: 
said session manager, in response to said add command and said 

delete command, respectively adding or deleting (240) a subscriber-indicated 
content stream from said playlist. 

4. The apparatus of claim 2, wherein: 
said session manager, in response to said skip forward command and 

said skip backwards command, causing said server controller to begin 
providing to said subscriber equipment, respectively, a next content stream 
or a previous content stream within said playlist. 
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5. The apparatus of claim 2, wherein each content stream defined by 
said playlist has associated with it a fast forward stream and a fast rewind 
stream, and wherein: 

said session manager, in response to said fast forward command and 
5 said rewind command, causing said server controller to begin providing to 
said subscriber equipment, respectively, said fast forward stream or said 
fast rewind stream associated with a presently provided content stream 

6. The apparatus of claim 1, wherein: 

10 said server controller, in response to a remaining portion of a 

provided content stream being below a threshold level, communicating a 
termination notification to said session manager. 

7. The apparatus of claim 6, wherein: 

15 said session manager, in response to said termination notification, 

communicating to said server controller a next content stream to be 
provided to said subscriber equipment. 



8. In an information distribution system including provider equipment 
20 and subscriber equipment, said provider equipment communicating content 
to said subscriber equipment via a distribution network, a provider method 
comprising the steps of: 

establishing a session with a subscriber; 

generating a playlist for said subscriber if a playlist does not 
25 presently exist, said playlist determining a sequence of content streams to 
be retrieved from a server and coupled to a transport processor for 
distribution to said subscriber via said distribution network; 

in the case of said subscriber transmitting a playlist modification 
command, modifying said playlist in response to said playlist modification 
30 command; 

in the case of said subscriber transmitting a content stream 
modification command, modifying said content stream in response to said 
content stream modification command; 
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closing a present content stream to be retrieved from a server and 
provided to a transport processor, said transport processor inserting said 
present content into a transport stream being provided to said subscriber 
via a distribution network (104); 

5 determining a next content stream to be provided to said subscriber; 

and 

communicating said next content stream to be provided to said server 
to a server controller, said server controller responsively causing said next 
content stream to be provided to said transport processor upon the 
10 termination of the present content stream provided to said transport 
processor. 



9. The method of claim 8, wherein: 

said modification commands comprise at least one of an add 
15 command, a delete command, a skip forward command, a skip backwards 
command, a fast forward command and a rewind command. 

10. The method of claim 9, further comprising the step of: 
adding or deleting (240) a subscriber-indicated content stream from 

said playlist in response to, respectively, said add command and said delete 
command. 



11. The method of claim 9, wherein each content stream defined by said 
playlist has associated with it a fast forward stream and a fast rewind 
stream, said method further comprising the step of: 

in response to said fast forward command and said rewind command, 
causing said server controller to begin providing to said subscriber 
equipment, respectively, said fast forward stream or said fast rewind stream 
associated with a presently provided content stream 

12. The method of claim 8, wherein: 

in response to a remaining portion of a provided content stream being 
below a threshold level, communicating a termination notification to said 
session manager. ' 
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13. The apparatus of claim 12, wherein: 

said session manager, in response to said termination notification, 
communicating to said server controller a next content stream to be 
5 provided to said subscriber equipment. 
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